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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1,1 36(a). In no event, however, may a reply be timely filed 
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- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )IEI Responsive to communication{s) filed on 1 7 July 2006 . 
2a)n This action is FINAL. 2b)S This action is non-final. 

3) n Since this application is in condition for allowance except for fomial matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
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4a) Of the above claim(s) is/are withdrawn from consideration. 
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6) S Claim(s) 1-16 and 18-19 is/are rejected. 

7) ^ Claim(s) f? is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 
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9) D The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required If the drawing(s) is objected to. See 37 CFR 1.121 (d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 
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Attachment(s) 

1) K Notice of References Cited (PTO-892) 

2) Q Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statement(s) (PTO/SB/08) 

Paper No(s)/Mail Date . 



4) □ Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) D Notice of Infomial Patent Application 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 08-06) 



Office Action Summary 



Part of Paper No./Mall Date 20060913 



Application/Control Number: 10/026,711 
Art Unit: 2624 



Page 2 



Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this appUcation after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.114. Applicant's submission filed on 07/17/2006 has been entered. 

Response to Amendment and Arguments 

2. The rejection of claims 5-6, 10, 16-18 under 35 U.S.C. 112, first paragraph, is withdrawn. 

3. The objection of claims 3-6 and 9-10 is withdrawn. 

4. Applicant's argxmients with regard to claim 1 have been fiiUy considered, but are not 
considered persuasive because of the following reasons: 

Regarding claim 1, the AppUcant argues (Remarks, bottom of page 10) that Ohya does 
not teach the comparing image or image features of character strings. The Examiner respectfiiUy 
disagrees. Through out the reference, Ohya clearly teaches the calculation of 
differences/comparing/similarity analysis of image features e.g. "evaluating gray-level different 
between adjacent regions" at page 215, column 2, first paragraph of the character 
strings/characters. 

5. Applicant's arguments, see Remarks page 1 1, filed 07/17/2006, with respect to the 
rejection(s) of claim(s) 1 under 35 U.S.C. 103 (a) have been fiiUy considered and are persuasive. 
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Therefore, the rejection has been withdrawn. However, upon further consideration, a new 
ground(s) of rejection is made in view of Bauer et al. U.S. Patent No. 6,751,603. 

Claim Rejections - 35 USC § 112 

6. The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of making 
and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carrying out his invention. 

7. Claims 5-6 and 9-10 are rejected under 35 U.S.C. 1 12, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter which 
was not described in the specification in such a way as to reasonably convey to one skilled in the 
relevant art that the inventor(s), at the time the application was filed, had possession of the 
claimed invention. The disclosures of limitations . .feature to be extracted are one-dimensional 
featxu-e strings whosS numbers of edges in a vertical direction are obtained by binarizing 
luminance of each pixel and counting numbers of luminance changes in the character 
regions, when the character strings are arrayed horizontally. . (emphasis added) (claims 5 
and 10) and "... feature to be extracted are one-dimensional feature strings whose numbers of 
edges in a horizontal direction are obtained by binarizing luminance of each pixel and 
counting numbers of luminance changes in the character regions, when the character 
strings are arrayed vertically . . (emphasis added) (claim 6) and . .extracts equi-luminance 
pixels strings each of which has a length equal to or longer than a pre-designated length and has 
a luminance difference from a background within a pre-designated range." (claim 9) are not 
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found. The Applicant must clearly show (page number and line number) the support for the 
claimed Umitation and amended limitation. 

Claim Rejections - 35 USC §103 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

9. Claims 1, 2-4, 7-8, 1 1-14, 16, and 18-19 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ohya et al. '^Recognizing characters in scene images", I.E.E.E. Pattern 
Analysis and Machine Intelligence, Volume 16, Issue 2, Pages 214-220, and further in view of 
Bauer et al. U.S. Patent No. 6,751,603. 

Regarding claim 1, Ohya teaches a method for searching at least one character image 
embedded in an image (abstract), comprising: 
providing the image (abstract); 

detecting a character region in the image (page 215, second column, first paragraph) based upon 
a shape thereof(FIG. 1-FIG. 3); 

extracting a first feature of the character region (FIG. 2, region nimiber =1); 
providing a character string of interest (FIG. 1-FIG.3); 

extracting a second feature fi-om the input character string (FIG. 2, region number = 2); 
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comparing the first image feature with the second image feature to determine a level of 
similarity (page 215, second colimm, first paragraph and page 217, first column); and 
outputting the character region or the input image comprising the character region with based 
on the level of similarity (FIG. 4). 

However, Ohya does not explicitly teach that an input of character string can be by from user's 
interest. Bauer further teaches a method of processing document and searching string image 
(abstract and column 5, lines 45-57) wherein receiving an input of a character string of interest 
by a user ("In particular, the method results in the suggestion of an individual data file name 
based on a character or character string input by the user" at column 2, lines 32-35). Modifying 
Ohya's method of method of searching for character string image according to Bauer would be 
able to user to receive interested character string from user. This would improve processing 
because it would help user to identify file in plurality of files rapidly (abstract, first 2 lines) and 
therefore, it would have been obvious to one of the ordinary skill in the art to modify Ohya 
according to Bauer. 

Regarding claim 2, Ohya teaches the display or both high level of similar and low level 
of similarity (page 217, first column). However, Ohya does not explicitly teach the method for 
searching character image in an image, wherein at the step of outputting said character region 
outputs character regions in the descending order of the level of similarity. The Examiner takes 
Office Notice that it would have been obvious to one skilled in the art that the level of similarity 
can be output at the descending or ascending order as a conventional displaying order. This 
type of output (descending/ascending) output would have been obvious to one of the ordinary 
skilled in the art to organize the output data/level of similarity. 
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Regarding claim 3, Ohya teaches the method for searching at least one character string 
image in an image wherein the step of detecting said character region involves extracting equi- 
luminance pixel strings each of which has luminance differences from a backgroimd in a pre- 
designated range has a length of a pre-designated extent (the detection and extraction of 
character if pixels of the detected character have similar pixel values which are different from 
the background pixels values) (FIG. 1-FIG.3 and page 215). 

F;or claim 4, Ohya teaches the method for searching at least one character string image in 
an image wherein the step of detecting said character region involves extracting equi-luminance 
pixel strings, each of which has a length equal to or longer than a pre-designated length in both 
vertical and horizontal directions and has a luminance difference from a background within a 
pre-designed range in both of the vertical and horizontal directions (the detection and extraction 
of character if pixels of the detected character have similar pixel values which are different from 
the background pixels values) (FIG. 1-FIG.3 and page 215). 

For claim 7, please refer back to claim 1 for the teaching. In addition, Ohya teaches a 
mean for detecting a character region from the frame of the entered image on the basis of its 
shape (FIG. 1-3). And an output means for outputting as the result of search the character region 
matching the visual features in respect of which the level of similarity has been determined or a 
frame of image containing the region (page 215; FIG. 1-4 and page 217, first column, first 
paragraph). 

For claim 8, please refer back to claim 2 for fiirther teachings and explanations. 

For claim 11, please refer back to claims 1 and 7 for further teachings and explanations. 
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Regarding claim 12, Ohya discloses the method whereby the step of detecting said 
character region includes extracting lines width a width in a specific range and extracting a 
concentrated region of the extracted lines as said character region (FIG. 1, FIG. 2 and page 216, 
B. Detecting Character Candidate Regions). 

For claim 13, please refer back to claims 3 and 4 for the teachings and explanations. 

For claim 14, Ohya also discloses the method whereby the line width is taken in vertical 
and horizontal directions (FIG. 1 and FIG. 2). 

Regarding claim 16, Ohya further teaches the program wherein the module for detecting 
said character region extracts a character image feature string along one dimension of the 
character region (the extraction/segmentation by either vertical or horizontal direction and thus 
along one dimension of character region (page 215, column 2, A. Image Segmentation Using 
Local Thresholding, first paragraph; FIG. 2 and FIG. 3). 

Regarding claim 18, Ohya discloses the method further comprising a step of removing 
non-character background in the image by outlining the character region with a rectangle box 
having a sufficient margin, then removing pixels outside of the rectangle box, and wherein the 
output step outputs the character with the rectangle box (FIG. 2; FIG. 3; page 216 and page 
218). 

For claim 19, please refer back to claim 18 for the teachings. 

10. Claim 15 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination 
of Ohya et al. "Recognizing characters in scene images", I.E.E.E. Pattem Analysis and Machine 
Intelligence, Volume 16, Issue 2, Pages 214-220 and Bauer et al. U.S. Patent No. 6,751,603, as 
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described in claim 1 1-14, and further in view of Akira et al. "A method for recognizing character 
strings from maps using linguistic knowledge.", LE.E.E. 1993, pages: 561-564. 

Regarding claim 15, Ohya does not explicitly teach the concept of concentrated region is 
decided by projections of the lines in the vertical and horizontal directions. However, Akira 
teaches a method of searching/recognition of character image embedded in an image (character 
from maps of various figures) (abstract) wherein concentrated region (pixel density) is decided 
by projections (multiplying pixels) of the lines in the vertical and horizontal directions (page 
562, first column, 3.1 Character Candidates Extraction). Modifying Ohya's method of searching 
character image embedded in an image according to Akira would able to one of the ordinary 
skilled in the art to determine the concentration of the image region by projection of the lines 
(multiplying pixels) in the x direction with a pixel number in the y direction. This would 
improve processing and therefore, it would have been obvious to one of the ordinary skill in the 
art to modify Ohya according to Akira. 



Allowable Subject Matter 
1 1 . Claims 5-6, 9-10 and 17 are objected to as being dependent upon a rejected base claim, 
but would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. Regarding claims 5-6, and 10, there is no prior art found 
to teach the limitations . .feature to be extracted are one-dimensional feature strings whose 
numbers of edges in a vertical direction are obtained by binarizing luminance of each pixel and 
counting numbers of luminance changes in the character regions, when the character strings are 
arrayed horizontally. . ." (claims 5 and 10); . . feature to be extracted are one-dimensional 
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feature strings whose numbers of edges in a horizontal direction are obtained by binarizing 
luminance of each pixel and counting numbers of luminance changes in the character regions, 
when the character strings are arrayed vertically . . (claim 6); . .extracts equi-luminance pixels 
strings each of which has a length equal to or longer than a pre-designated length and has a 
luminance difference from a background within a pre-designated range." (claim 9) and "... a 
module for removing line border blurring by correcting a border pixel luminance value into a 
maximum or minimum luminance value into a maximum or minimum luminance value of 
adjacent pixels" (claim 17). 

12. Also, claims 5-6 and 9-10 would be allowable if rewritten to overcome the rejection(s) 
under 35 U.S.C. 1 12, 1st paragraph, set forth in this Office action and to include all of the 
limitations of the base claim and any intervening claims. 
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Contact Information 



13. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Brian Q. Le whose telephone number is 571-272-7424. The 
examiner can normally be reached on 8:30 A.M - 5:30 P.M. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on 571-272-7429. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for impublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 




Brian Le 

September 20, 2006 



